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As  operators  become  dependent  on  systems 
for  decision  support,  their  decisions  may  be  susceptible 
to  order  effects  which  may  result  in  over-weighting  of 
_ prior  or  recent  information. _ 


Does  the  theory  of  anchoring  & 
adjusting  on  average  accurately 
predict  the  results  of  a  long  series 
of  sequentially  presented 
information  when  complexity  and 
sequencing  are  manipulated? 
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Sk  =  Sk-i  +  Wk[s(Xk)  -  R] 


S,^  =  degree  of  belief  in  some  hypothesis 
5,^.1  =  anchor  or  prior  opinion 

w,^  =  adjustment  weight  for  the  kth  piece  of  evidence 
s(x J  =  subjective  evaluation  of  the  kth  piece  of  evidence 

R  =  reference  point  or  background  to  which  the  impact  of  the 
kth  piece  of  evidence  is  evafuated.  R  =  0  in  evaluative  tasks 
and  5,^.1  in  estimative  tasks. 


Sk  =  Sk_i  +  -  R]  for  s(x,^)  <  R  (negative  evidence) 

Sk  =  Sk_i  +C^^"Sk^25ls(x,^)  -  R]  for  s(x,^)  >  R  (positive 
evidence) 

■  a  =  sensitivity  toward  negative  evidence;  p  =  sensitivity  toward 
positive  evidence. 

■  As  information  accumulates  and  individuals  become  more 
committed  to  their  beliefs,  values  of  a  and  p  decrease  (become 
less  sensitive). 
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result  in  primacy  in  a  long  series  of 
sequentially  presented  information 
when  complexity  &.  sequencing  are 
manipulated. 

2.  Complexity  and  sequencing  wili 
significantly  affect  beiief  revision 
through  a  mediator,  mentai  effort. 

■  High  Mental  Effort  -  Primacy 

■  Low  Mentai  Effort  -  Recency 
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Instruction. 

■  ROTC  cadets  were  used  based  on  their  familiarity  with 
the  military. 

■  Each  cadet  was  asked  to  sign  a  consent  form  approved 
by  GMU's  Human  Subjects  Review  Board  and  then  they 
were  then  given  a  booklet  containing  both  tasks. 

■  Beliefs  were  rated  on  a  scale  of  0-100. 

■  Mental  effort  was  measured  through  two  questions  where 
responses  were  obtained  using  a  1-9  Likert-type  scale 
after  each  scenario.  This  measure  was  based  on  a 
method  used  when  measuring  cognitive  load. 

■  Pilot  Test  was  conducted  with  ROTC  Instructors  &  GMU 
undergraduate  students  to  validate  procedures,  evidence 
coding,  and  to  serve  as  a  manipulation  check. 

■  Performed  an  ANOVA  for  a  mixed  factor  design  to  test 
my  first  hypothesis. 

■  Performed  a  path  analysis  to  test  the  second  hypothesis. 
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-  Included  MS  Is  (freshmen)  in  Experiment 

■  Lengthened  Scenarios 

■  Bolded  and  underlined  key  information 

2.  Mental  Effort  manipulation  check 

■  14  SEOR  Undergrad  Students 

■  Significant  difference  (p-value<  0.0001) 

■  Movement  of  neutral  information 

3.  Verbal  feedback  in  the  mixed  manipulation  to 
ensure  correct  coding  of  neutral  information 

■  Additional  4  GMU  Undergrad  Students 

■  Special  evidence  integration  instructions 
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*  Denotes  sig.  at  <  0.05,  **Denotes  sig.  at  <  0.01, 

***Denotes  sig.  at  <0.005,  ****Denotes  sig.  at  <0.001 .  "18 


Anchoring  and  adjusting  does  not 
always  result  in  primacy  in  a  long 
series  of  evidence  when  task 
variables  are  manipulated. 


Complexity  and  sequencing  was  not 
mediated  through  mental  effort. 


■  Complexity 

■  Familiarity 

■  Amount  of  information 

■  Sequencing 

■  Scenario  position 

■  Potential  role  of  individual  differences 

■  MS  Level 

■  Experience 

■  Working  Memory 

■  Intelligence 
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■  Individual  Measurement  of  Item  Sensitivity 

-  Extending  model  with  and  (3^ 

■  Direct  measurement  (fMRI) 

■  Secondary  Workload  Task 

■  Mediating  Framework 

■  Operationalized  a  and  3  (sensitivity)  based  on 
Hogarth  &  Einhorn's  (1992)  theory 

■  Anchoring  &  Adjusting  accounts  for  the  grouped 
manipulation 

■  Effect  of  Neutral  Information  on  mixed  sequencing  of 
evidence 

■  Engineering  systems  (such  as  Command  & 
Control)  so  operators  weight  information 
appropriately. 
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■  US  Army  for  funding  my  research 

■  Dr.  Loerch,  Dr.  Boehm-Davis,  Dr.  Schum,  &  Dr. 
Miller  for  advising  &  reviewing  this  research  and 
assisting  with  the  statistical  analysis 

■  LTC  Jim  Overbye,  instructors,  &  ROTC  Cadets  at 
GMU's  ROTC  detachment  for  supporting  the 
study 

■  GMU's  Systems  Engineering  Undergraduate 
students  for  supporting  the  pilot  testing 

■  Views,  opinions,  and  findings  presented  are 
those  of  the  author  and  should  not  be  construed 
as  an  official  DoD  position,  policy,  or  decision 


Back  Up  Slides 


Adelman,  L.,  Bresnick,  T.,  Black,  P.  K.,  Marvin,  F.  F.,  &  Sak,  S.  G. 
(1996).  Research  with  patriot  air  defense  officers:  Examining 
information  order  effects,  Human  Factors,  38,  250-261. 

Adelman,  L.,  Bresnick,  T.A.  Christian,  M.,  Gualtieri,  J.  &  Minionis,  D.  (1997). 
Demonstrating  the  effect  of  context  on  order  effects  for  an  Army  Air 
Defense  task  using  the  Patriot  simulator.  Journal  of  Behavioral  Decision 
Making,  10,  327-342. 

Anderson,  N.  H.  (1959).  Test  of  a  model  for  opinion  change.  Journal  of 
Abnormal  and  Social  Psychology,  5,  371-381 . 

Anderson,  N.  H.  (1981).  Foundations  of  Information  Integration  Theory. 

New  York:  Academic  Press. 

Catena,  A.,  Maldonado,  A.,  &  Candido,  A.  (1998).  The  Effect  of  the 

Frequency  of  Judgment  and  the  Type  of  Trials  on  Covariation  Learning, 
Journal  of  Experimental  Psychology:  Human  Perception  &  Performance, 
24,  481-495. 

Collins,  D.  J.  &  Shanks,  D.  R.  (2002).  Momentary  and  integrative  response 
strategies  in  causal  judgment.  Memory  &  Cognition,  30,  1138-1147. 


24 


ennis,  M.  J.  &  Ahn,  W.  K.  (2001).  Primacy  in  causal  strength  judgments: 
The  effect  of  initial  evidence  for  generative  versus  inhibitory 
relationships,  Memory  &  Cognition,  29,  152-164. 

Hogarth,  R.M.,  Einhorn,  H.J.  (1992).  Order  effects  in  belief  updating:  The 
Belief-Adjustment  Model,  Cognitive  Psychology,  24,  1-55. 

Jones,  E.  E.,  Rock,  L.,  Shaver,  K.  G.,  Goethals,  G.  R.,  &  Ward,  L. 

M.  (1968).  Pattern  of  performance  and  ability  attribution:  An 
unexpected  primacy  effect.  Journal  of  Personality  and  Social 
Psychology,  10(4),  317-340. 

Lopez,  F.  J.,  Shanks,  D.  R.,  Almaraz,  J.,  &  Fernandez,  P.  (1998).  Effects  of 
Trial  Order  on  Contingency  Judgments:  A  Comparison  of  Associative 
and  Probabilistic  Contrast  Accounts,  Journal  of  Experimental 
Psychology:  Learning,  Memory,  &  Cognition,  24,  672-694. 

McKenzie,  C.  R.  M.,  Lee,  S.  M.,  &  Chen,  K.  K.  (2002).  When 
negative  evidence  increases  confidence:  Change  in  belief  after  hearing 
two  sides  of  a  dispute.  Journal  of  Behavioral  Decision  Making,  15,  1-17. 

Paas,  F.  (1992).  Training  strategies  for  attaining  transfer  of 
problem-solving  skill  in  statistics:  A  cognitive-load  approach. 
Journal  of  Educational  Psychology,  84(4),  429-434.  25 


ennington,  N.  and  R.  Hastie  (1992).  Explaining  the  Evidence  -  Tests  of 
the  Story  Model  for  Juror  Decision-Making,  Journal  of  Personality  and 
Social  Psychology,  62,  189-206. 

Pennington,  N.  &  Hastie,  R.  (1993).  Reasoning  in  explanation-based 
decision  making.  Cognition,  49,  123-163. 

Reid,  G.  B.,  &  Nygren,  T.  E.  (1988).  The  subjective  workload 
assessment  technique:  A  scaling  procedure  for  measuring 
mental  workload.  In  P.  A.  HancocK  8i  N.  Meshkati  (Eds.), 
Human  Mental  Workload  (pp.  185-218).  Amsterdam:  Elsevier 
Science  Publishers. 


Schlottmann,  A.  &  Anderson,  N.  H.  (1995).  Belief  Revision  in  Children  - 
Serial  Judgment  in  Social  Cognition  and  Decision-Making  Domains, 
Journal  of  Experimental  Psychology-Learning  Memory  and  Cognition, 
21,  1349-1364. 


Tubbs,  R.  M.,  Gaeth,  G.  J.,  Levin,  I.  P.,  SiVancsdol,  L.  A.  (1993). 
Order  effects  in  belief  updating  with  consistent  and  inconsistent 
evidence.  Journal  of  Behavioral  Decision  Making,  6(4),  257- 
269. 


26 


Connplexity 

Simple 

Complex 

Sequencing 

Order  1 

Order  2 

Order  1 
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Grouped 

91 

12 

91 

12 
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13 
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13 
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Complexity  (Simple  or  Complex)  is  within  subject  and  Sequencing 
(Grouped  or  Mixed)  and  Order  is  between  subject 


Note:  1 .  Three  participants’  initial  judgment  was  greater  than  90. 
2.  One  participant’s  initial  judgment  was  greater  than  90 
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